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Abstract — We present a novel iterative algoritlim for detec- 
tion of binary Markov random fields (MRFs) corrupted by two- 
dimensional (2D) intersymbol interference (ISI) and additive 
white Gaussian noise (AWGN). We assume a first-order binary 
MRF as a simple model for correlated images. We assume a 2D 
digital storage channel, where the MRF is interleaved before 
being written and then read by a 2D transducer; such channels 
occur in recently proposed optical disk storage systems. The 
detection algorithm is a concatenation of two soft-input/soft- 
output (SISO) detectors: an iterative row-column soft-decision 
feedback (IRCSDF) ISI detector, and a MRF detector. The 
MRF detector is a SISO version of the stochastic relaxation 
algorithm by Geman and Geman in IEEE Trans. Pattern Anal, 
and Mach. Intell., Nov. 1984. On the 2 x 2 averaging-mask ISI 
channel, at a bit error rate (BER) of 10~^, the concatenated 
algorithm achieves SNR savings of between 0.5 and 2.0 dB 
over the IRCSDF detector alone; the savings increase as the 
MRFs become more correlated, or as the SNR decreases. The 
algorithm is also fairly robust to mismatches between the 
assumed and actual MRF parameters. 

I. Introduction 

This paper considers the detection of an M x N binary- 
valued 2D MRF F transmitted over the digital storage 
channel shown in Fig. [2 The received image 

r(m, n) — ft.(fc, V)F{rn — k,n — I) + w{m, n), (1) 



where 0<m<M-l, 0<n<N-l, h{k, I) is a finite- 
impulse-response 2D blurring mask, F — 2 x tt{F) — 1 is 
an interleaved and level-shifted version of F, the w{in, n) 
are zero mean i.i.d. Gaussian random variables (r.v.s) with 
variance cr^, and the double sum is computed over the mask 
support region Sh = {{k,l) : h{k,l) ^ 0}. The MRF F 
takes pixel values from {0, 1}, and is correlated according 
to the following Markov property [1]: 



Pr(-Fm,n = fviji\Fk,i = fk,h {k, I) ^ (m, n)) 



(2) 



= Pr(iv„,„ f,n,n\Fk,l = fk,l, (k, I) e Tm,n) 

In F„i,n denotes pixel (m, n) of the MRF, fkj denotes 
a particular value of pixel {k,l), and J>„ „ denotes the 
first-order neighborhood of pixel (m, n): J^m,n = {{^, n — 
1), (m, n + 1), (m — l,n),{m+ 1, n)}. The MRF F is gen- 
erated by a Gibbs sampler based on the Ising model, which 
is characterized by a two parameter energy function. It is 
assumed that the detector knows the energy parameters (and 
therefore the complete Markov model) of the transmitted 
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Fig. 1. Block diagram of tlie digital storage channel assumed in this paper; 
the TT represents an image interleaver, and * represents 2D convolution. 
Level shifting from {0, 1} to { — 1, 1}, peii'ormed after the interleaver, is 
not shown. 



MRF. Because of the interleaver, it is assumed that the pixels 
in F are independent and identically distributed (i.i.d.), with 
Pr{F(r7i, n) = 0} = po = 1 — pi for all (m, n), where the a 
priori probabilities po and pi need not in general equal 1/2. 

The motivating application for the channel model em- 
ployed in this paper is 2D magnetic or optical storage 
systems, which are subject to 2D ISI. Such systems (e.g., 
[2]) store the image F in its original 2D form, rather than 
converting the image to a ID sequence and storing it on 
ID tracks. Over the past 10 years, a number of papers 
(e.g., [3]-[14]) have considered the detection problem for 
binary images on the 2D ISI channel, under the assumption 
that the transmitted image pixels are i.i.d. and equiprobable. 
In practice, this i.i.d. assumption can be largely achieved 
by interleaving the original image before storage (as in 
Fig. and deinterleaving it after detection. However, in 
practice the original image is often correlated. Uncompressed 
natural images are highly correlated; these typically occur in 
diagnostic medical imaging where distortion due to lossy 
compression is intolerable, and the time required for lossless 
compression/decompression may not be available. Images 
usually retain some correlation even if stored in compressed 
format, because practical lossless (or lossy) image compres- 
sion schemes do not completely decorrelate the image. 

The principal contribution of the present paper is an 
iterative detection scheme that exploits the correlation in 
the original image to achieve significant SNR savings over 
ISI detection schemes which do not account for correlated 
input images. Although we model the image correlation by 
a simple first-order Markov random field, our results give at 
least a proof of principle that can be further explored with 
more realistic image models. A key innovation introduced in 
this paper is a soft-input, soft-output MRF detection algo- 



rithm, based on the stochastic relaxation image restoration 
algorithm of [1]. The ISI detector employed in this paper 
is described in [12], [14], where comparisons with several 
previously published algorithms show that it is among the 
best performing ISI detectors in the public domain. 

II. The Concatenated Detector 

A block diagram of the concatenated system is shown 
in Fig. 121 It operates according to the "turbo principle" 
(after turbo-codes [15]), whereby two or more SISO decoders 
exchange extrinsic information and iterate until convergence. 
The received image r is an input to the ISI detector, which 
attempts to remove the ISI under the assumption that the 
pixels of F are i.i.d. The ISI detector outputs deinterleaved 
extrinsic log-likelihood ratios (LLRs) to the MRF detector, 
which estimates the original MRF F, and feeds back inter- 
leaved extrinsic LLRs to the ISI detector 
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Fig. 2. Block diagram of the concatenated detector. 



A. The ISI Detector 

A detailed description of the ISI detector, including per- 
formance comparisons with a number of other previously 
published 2D ISI algorithms, appears in [12], [14]. The ISI 
detector is therefore only briefly described here. 
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Fig. 3. ISI detector block diagram. The extrinsic input from the MRF 
detector into the row-SISO is not shown. 

Figure|3lis a block diagram of the ISI detector, which em- 
ploys an iterative, row-column soft-decision feedback algo- 
rithm (IRCSDFA). The IRCSDFA consists of two SISO mod- 
ules, run on rows and columns, which exchange weighted 
soft information estimates of the interleaved MRF F. Each 
module runs the BCJR algorithm [16] on several rows 
(columns) of the image at once, and uses soft decision feed- 
back from previously-processed rows (columns), to arrive 
at an LLR estimate L of the current row (or column.) The 
weight w attenuates the LLR estimates, to correct for the 
over-confidence effect resulting from use of soft decision 
feedback (SDF). 

The row-SISO trellis state and input block for the mth row 
of an image corrupted by 2 x 2 ISI is shown in Fig. 0] A 
trellis is generated by shifting this block right one column at 
a time through all the pixels in a given row, and taking into 
account the eight possible values of the three input pixels. 



The resulting trellis has eight states and eight branches 
per state. Each trellis branch metric is the sum of three 
terms; each term is the squared Euclidean distance (SED) 
between one of the 2D inner products shown in Fig. |4] and 
the corresponding received pixel r{m,n), r{m + l,n), or 
r(m + 2, n). Each 2D inner product is computed between the 
inverted convolution mask h{m-'k, n~l) and the appropriate 
block of state, input, and feedback pixels indicated in Fig.|4l 
to compute inner product 2 shown in the figure, the inverted 
mask's h{0,0) coefficient overlays the current pixel position 
{in,n). The algorithm uses the LLRs uji and uj2 from the 
previously processed row as soft-decision feedback when 
computing modified pixel transition probabilities 7i(rfc, s' , s) 
in the BCJR algorithm, where i = [10,11,12] and r = 
[r{m, n), r{m+l, n), r(m + 2, n)] denote input and received 
pixel vectors (as seen in Fig. |3, k denotes the iteration 
number, and the candidate input pixels ij take values from 
{ — 1,1} with a priori probabilities pq and pi. 
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Fig. 4. The ISI detector's row-SISO trellis states and inputs, for a 2 X 2 
mask. 

The modified 7 is the product of a modified conditional 
channel PDF ) (which takes into account the SDF LLRS 
LOi and L02, and which is described further in [12], [14]), 
trellis transition probabilities, and extrinsic information from 
the other decoder: 

7i(rfe7s',,s) =p'(rfc|u = 1,5'^. = s,Sk-i = s' 

X P(u = i|s, s) X P{s\s') X P{n = i|L). 

In (|3}, u — [uq,ui,U2] denotes estimate of the input 
vector [F{'m, n), F{m + 1, n), F{m + 2, n)]. For the given 
states s',s and input u, P(u = i|s, s') is or 1. Because 
the current input vector becomes the next state vector, the 
state transition probability is the product of the a priori 
probabilities (po or pi) of the independent components of 
u: PiySk = s\Sk-i — s') — 11^=0 = The extrinsic 
information probability P{u = i\L) is derived from the 
extrinsic input LLRs from the other detector 

The above-described IRCSDFA is similar to the ISI al- 
gorithm described in [7], [8], but with a number of key 
differences: (1) we have adapted our algorithm to handle non- 
equiprobable binary images; (2) we make decisions on only 
one row at a time, as opposed to multiple rows; (3) we use 
three inner products for a 2 x 2 mask, instead of two; and (4) 
we weight the LLRs passed between SISO modules. We have 
observed experimentally that the last two differences improve 
the performance of the IRCSDFA by about 1 dB, when it 
is run on source images of non-trivial size (i.e., 64 x 64 or 
bigger). 



To the best of our knowledge, the above-described IRCS- 
DFA gives the best pubHshed performance for equalization 
of the 2x2 averaging mask on non-trivially-sized source 
images, with the exception of the concatenated zig-zag 
algorithm of [13], which uses the IRCSDFA as a component. 
We chose the IRCSDFA for the experiments described in this 
paper because it is about half as complex as the concatenated 
zig-zag algorithm, and because the focus in this paper is on 
the improvements provided by concatenating a MRF detector 
with an ISI detector. 

B. The MRF Detector 

The MRF detector is designed to provide a maximum 
a posteriori (MAP) estimate of the original MRF F from 
its noisy version G = F + z, where z is zero mean 2D 
AWGN. The MRF detector's extrinsic input LLRs are the 
deinterleaved extrinsic output LLRs from the ISI detector: 

In practice, the ij^^^ are (approximately) conditionally 
normal, with conditional means /i+ and /i_ corresponding 
to pixel values of +1 or —1 in 7r^^(F). The MRF detector 
computes sample mean and variance estimates /t+, /t_, o-^, 
and (7^ for the two conditional input PDFs. The LLRs 
are then shifted and scaled to form the "noisy image" G, 
which has conditional means of and 1: 



G{m,n) = (Lir" (m, n) - - A-)- 

The conditional variances of G are estimated as 



(4) 



4 = (N+al + N^al)/{{N+ + N^){fi+ - A-)'), (5) 

where and are the number of positive and negative 
pixels in the input LLR image 

1) Generation of the MRF s: The conditional probabilities 
in (13 are calculated according to the Gibbs distribution [1] 

Pr(-Fm,n = fm,n\Fk,l — fk,l: £ Tm,n) 

e'£(U.^)/T (6) 



^f=o ' 



-£{f)/T 



The energy function 8 used to generate the MRFs in this 
paper follows the Ising model: 



(7) 



where Vm,n — /m,n-l + frn,n+l + fm-l,n + frn + l.n- The 

MRF becomes more correlated as the interaction coefficient 
/3 becomes increasingly large and negative. Coefficient a is 
related to the prior probability of pixel (m, n); a is set equal 
to —2/3 when the pixels are equiprobable. The "temperature" 
parameter T is set to one to generate the original MRFs, 
but is varied according to an annealing schedule during the 
stochastic relaxation algorithm used for MRF estimation. 
The method used to simulate the MRF is as follows [17]: 

1) Start with an i.i.d random configuration. 

2) Randomly chose two pixels. 

3) Compute the energy change A£ if these two pixels are 
switched. 



4) If A£ < 0, i.e., if the energy decreases, accept the 
switch. 

5) Otherwise, accept the switch with probability q oc 
exp i-A£). 

6) Go to 2) until the convergence occurs. 

This method ensures that the generated MRF has the same 
number of Os and Is as the initial configuration, and after 
the interleaver it has the same distribution as an i.i.d. source. 
Two examples of generated equiprobable MRFs are shown 
as images b and c in Fig.|5| In these images, black represents 
0, and white represents 1. Image b has (3 = —1.5, and image 
c has (3 — —3.0; from the figure it is clear that image c is 
more correlated than image b. Fig.|5l(a) shows an i.i.d. image 
for comparison. 




(a) 



(b) 



(c) 



Fig. 5. Three 64 X 64 equiprobable binary images: (a) i.i.d. image; (b) 
MRF with correlation parameter (3 = -1.5; (c) MRF with /3 = -3.0. 



If the source image is non-equiprobable, then parameter 
a in the MRF model needs to be modified as follows. If we 
level shift the binary alphabet for „ such that 0^—1 
and 1 1, let /3 = 0, and denote the level-shifted pixels by 
/4i_„, then £i{fm.n) = /m,nQ^i' whcrc we use the notation 
ai to denote the alpha constant for the { — 1,1} alphabet. So, 

pa = P{F' = -1) = , 



Pi = P(F;„^„ = +1) = 



g-ai _|_ gQi 



which gives 



"^ = 2^°Sp(F^,„ = +l) = 2^°^^- 

Now, we map the values from { — 1, 1} to {0, 1} and consider 
the energy function in Q: 

£l{fni.n) = 

= (2/„,n - l){ai + /3[(2/™,„-i - 1) 

+ (2/m,ri+l ^ 1) + (2/m-l,n — 1) 
+ (2/™+i^„ - 1)]} 

= 2ai/,„,„ + Al3v 

-2/3w™,„ + 4/3 - ai 

= -^.fm,ni-^ai -2(3 + l3Vm,n) 

-2/3i;„^„ + 4/3 - ai 

= -rfrn,nia + (3Vrn,n) - 2f3v.,n,n + 4/3 - Qfi, 



where 



a = iai-2/3=ilog^-2/?. 
2 4 pi 



(8) 



Given the neighbors Vm.n,—'^l3vm,n + 4/3 — ai is a constant 
which does not affect the probability computation. An ex- 
ample MRF with {po,pi) = (0.1,0.9) is shown in Fig. |6l 



Fig. 6. Non-equiprobable 64 X 64 binary MRF, with po 
P = -3.0. 
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2) Stochastic Relaxation: The stochastic relaxation al- 
gorithm of Geman and Geman (G&G) [1] is an itera- 
tive algorithm that proceeds at discrete time steps t = 
0,1,2,..., tmax; after each step, a new MRF estimate F{t) is 
obtained. For sufficiently large imax, the algorithm converges 
to a final estimate F that does not change appreciably 
for t > iniax- The initial estimate F{0) is computed by 
thresholding the noisy image G at 1/2. Given estimate F{t) 
at time t, at time t + 1 AI x N randomly chosen pixels 
of F{t) are visited. The value of each pixel (m, n) visited 
during the random scan is set to or 1 with probability 1/2. 
If the new value is different from its value fm,n at time t, 
then the energy difference A£p{m, n) = fp(NOT(/m „)) — 
£p{fm.n) is computed. In computing A£p{m,n), only one 
pixel at a time (i.e., pixel (m, n)) is changed; all other 
pixels retain their values from time t. If A£p{m,n) < 0, 
then the change is accepted: fm,n{t + 1) = NOT(/,„,„(t)). 
If A£p{m,n) > 0, the change is accepted with probabil- 
ity q — exp[—A£p{m,n)/T{t+l)]. The temperature T 
is gradually reduced according to a logarithmic annealing 
schedule: T{t) = C/log(l + t),l<t< t„iax; in this paper 
the value C — 3.0 is used for all simulations. 

The modified (a posteriori) energy function £p used by 
the MRF estimator at time t + 1 includes the difference 
energy between the noisy input image G and the current 
trial estimate: 

fp(/™,„) = £l{ f,n^n) + \\G - F{t, /„,,„) II (9) 

where F{t, fm,n) denotes the estimated MRF F{t) with 
pixel (m, n) taking the value and is estimated 

as in The extrinsic information LLRs L^^^{m,n) — 
log[Proxt(^'m,n = l)/Proxt(-F'm,n = 0)] represent indepen- 
dent a priori information about pixel {in,n). Hence, in the 
£i{fm,n) of (|9}, we replace a with 



After converting to probabilities using (|6}, this extra LLR 
term in a' results in the corresponding extrinsic probabili- 
ties Prcxt(-Fm,n = fva,n) appearing as independent weight 
factors in the renormalized expressions for the conditional 
probabilities of (|6}. Thus, as the LLRs Lj^^^(m, n) grow 
increasingly large with successive iterations of the concate- 
nated detector, they increasingly influence the estimates F 
arrived at by the MRF detector. 

The G&G algorithm provides only a binary estimate F of 
the MRF. To compute LLR estimates L^^^ {m,n) for each 
pixel, we use the following method, which is similar to that 
in [18], [19], where a soft-output G&G algorithm is used for 
recovery of noise-corrupted MRFs, and for iterative source- 
channel image decoding with MRF source models. After the 
stochastic relaxation algorithm convergences, we compute 
the conditional probabilities based on the MRF model: 



1 + e-("'+^^-.")/^ 

g-(a'+/3,,„,„)/T 
Pr(-Fm,n = l|^m,n) = ^ ^ g-(a'+/3t,„,„)/T " 

The LLRs i^^^(m,rt) are then computed as 

L^«F(m,n) = -(a' + /3t;„,„)/r 

T 

And since L^^^{m,n) is weighed by 1/T, 



(12) 



(13) 
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-{a + PVm,n)/T. 



(14) 
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(10) 



III. Simulation Results 

In early iterations of the concatenated system of Fig.|2 the 
ISI detector cannot remove all the ISI from received image 
r. Due to its use of soft-decision feedback, the ISI detector 
is also subject to error propagation, especially at low SNRs. 
Thus, the "noisy image" G supplied to the MRF detector 
by the ISI detector contains bit errors as well as Gaussian- 
like noise. To verify that the MRF detector can correct some 
of these bit errors (by exploiting the Markov structure of 
the image), we performed the simulation diagrammed in 
Fig- El The MRF passes through a binary-symmetric channel 
(BSC) with crossover probability p, followed by an AWGN 
channel, and is then detected with the MRF MAP estimator. 
Fig.|8]plots the BER of the hard decisions made at the MRF 
estimator's output versus the SNR lOlogj^g (var[F] /cr^) of 
the AWGN channel, for several values of the BSC error 
probability p. In every case, the MRF detector's output has an 
error floor lower than the value of p used in the simulation. 
This result strongly suggests that the MRF detector can 
improve the reliability of the information passed to it by 
the ISI detector 

All simulations of the concatenated system of Fig. loused 
the the 2x2 averaging mask (with h{k,l) = 1/4 for < 
{k, I) < 1) in the 2D convolution of Q. All simulations used 
5 outer iterations of the entire concatenated system, with one 
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Fig. 7. Experiment to test error correction capability of the MRF detector. 
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Fig. 8. Simulation results for the experiment shown in Fig. 171 



inner iteration of the ISI detector performed for each outer 
iteration. In the following subsections, we present simulation 
results for three cases: (1) the source image is a binary first 
order MRF, and the receiver knows the MRF parameters; 
(2) the source image is a binary first order MRF, and the 
receiver guesses the MRF parameters; and (3) the source 
image is a natural binary image, and the receiver guesses 
the most appropriate MRF parameters. 

A. MRF Source and Known Markov Parameters at the 
Receiver 

Monte-Carlo simulation results for the concatenated sys- 
tem, when the source images were the two 64 x 64 binary 
equiprobable MRFs shown in Fig. (Sjc) and (d), are shown 
in Fig.|9l The SNR in Fig.|9lis defined as in [12]: 



SNR = lOlogio (vai- F*h ja 



(15) 

where * denotes 2D convolution, and ct^ is the variance 
of the Gaussian rv.s w(m, n) in Q. The performance of 
the IRCSDF ISI detector alone on the received image r is 
also shown for comparison. When the BER is 2 x 10^^, 
the concatenated system gives SNR savings of 0.5 and 
1.5 dB over the ISI detector alone, for images b and c 
respectively. As the input MRF becomes more correlated, the 
MRF detector makes increasingly reliable decisions, thereby 
improving the system's SNR gain. At BER of 4 x 10^"^, 
the concatenated system saves about 1.0 and 2.7 dB over 
the ISI detector alone, for images b and c respectively. The 
gains increase at lower SNR, where the additional input of 
the MRF detector helps the ISI detector resolve an increased 
number of ambiguous cases. 

We also considered first order MRFs with non- 
equiprobable pixels. Fig. Qol shows simulation results on 
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Fig. 9. Simulation results for the concatenated system of Fig. |2] on the 
2D ISI channel with 2x2 averaging mask and AWGN, for MRFs b and c 
shown in Fig. |5] The performance of the ISI detector alone is also shown 
for comparison. 



the po = 0.1, /3 = -3.0 MRF of Fig. ^ The figure 
shows performance of the concatenated system, as well as 
the performances of the non-equiprobable and equiprobable 
ISI detectors alone. Non-equiprobable ISI detection offers 
little gain at high SNR, but saves between 0.5 and 1 dB 
at lower SNRs. The addition of the MRF detector (with 
modified a as in (|8j) gives SNR savings of about 1 dB at 
BER 2 X lO-'', and about 3 dB at BER 10"^^ oygj. 
equiprobable ISI detection alone. A similar set of simulation 
results, but with po = 0.01, is shown in Fig. ^2 Now 
the gain of non-equiprobable ISI compared to equiprobable 
ISI detection is higher: about 0.5 dB at BER lO"'^. But 
the gain of the concatenated system over non-equiprobable 
ISI is smaller: about 0.3 dB at BER 2 x 10"^. Clearly 
it is worth exploiting a non-uniform pixel distribution by 
using the non-equiprobable concatenated system in place 
of equiprobable ISI detection alone, although for extremely 
skewed distributions, non-equiprobable ISI detection alone 
achieves most of the available SNR gain. 

It is also worth noting that the concatenated algorithm 
greatly outperforms the standard G&G algorithm applied 
to a non-interleaved MRF passed through the ISI channel. 
Simulation results for the G&G algorithm alone operating on 
a /? = —3.0 MRF passed through the 2x2 averaging-mask 
ISI channel are shown in Fig. The SNR in this figure is 
defined by replacing F by F in jl5t . From the figure it is 
clear that the G&G algorithm alone has a BER floor of about 
1.5 X 10~^, and thus is not suitable for 2D digital storage 
applications, where much lower BERs are required. 

B. MRF Source and Unknown Markov Parameters at the 
Receiver 

If the MRF detector must estimate the Markov model 
parameters, there will be some estimation error between the 
actual and estimated parameters. This leads to the question: 
how accurate must the model parameters be in order to 
achieve performance gains similar to those seen when the 
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Fig. 10. Simulation results for the concatenated system of Fig.|2|on the 2D 
ISI channel with 2x2 averaging mask and AWGN, for the non-equiprobable 
MRP with po = 0.1 and (3 = —3.0 shown in Fig. |6] The performances of 
the equiprobable and non-equiprobable ISI detectors alone are also shown 
for comparison. 
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Fig. 11. Simulation results for the concatenated system of Fig.|2|on the 2D 
ISI channel with 2x2 averaging mask and AWGN. for a non-equiprobable 
MRF with Po = 0.01 and /3 = —3.0. The performances of the equiprobable 
and non-equiprobable ISI detectors alone are also shown for comparison. 

parameters are known exactly? 

To answer this question, we did a number of simulations 
using the equiprobable MRFs of Fig. Isjb) and (c), in which 
the assumed MRF parameter /? did not match the actual 
parameter. These simulation results are shown in Figs. [T3l 
and 1141 In Fig. the source image has /3 = —1.5. At 
high SNR, there is a mismatch penalty of about 0.2 or 0.3 
dB when the receiver assumes that /3 is one of the values 
(—0.5, —0.75, —3.0), but this still leads to a gain of about 
0.2 dB over the ISI-only case. Only when f3 is assumed to be 
—4.5 does the concatenated system perform worse than the 
ISI detector alone. Interestingly, at low SNR, the assumed 
values of —3.0 and —4.5 give almost identical results to the 
correct value of —1.5. The concatenated system thus appears 
to be quite robust to receiver parameter mismatch, at both 
high and low SNRs. 

The results shown in Fig. [21 where the source MRF has 
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Fig. 12. Simulation results for the standard Geman and Geman stochastic 
relaxation algorithm applied to a MRF with correlation parameter /3 = 
—3.0, that has passed through the 2D ISI channel with 2x2 averaging 
mask and AWGN without being interleaved first. 

(3 — —3.0, suggest that robustness to parameter mismatch 
increases as the source MRF becomes more correlated. At 
high SNR, assumed values of /3 in a range between —1.5 and 
— 10.0 give gains of more than 1 dB compared to ISI-only 
detection; assumed values of —4.5 and —6.0 perform as well 
as the correct value of f3 — —3.0. 

C. Natural Image Sources 

We also tested the performance of our concatenated MRF- 
ISI detector on the two natural binary images "chair" and 
"man" shown in Fig.^] In these images, the numbers of Os 
and Is are nearly equal, so we used the equiprobable version 
of the MRF-ISI system. 

Without doing any model estimation, we simply used our 
first order MRF model with several guessed values of /? 
(namely, —1.5, —3.0, —4.5, and —6.0) to model these two 
images. The simulation results for the chair and man images 
appear in Figs. 1161 andll7l For these natural images at high 
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10"° I • • • • • ■ ' 1 

6 7 8 9 10 11 12 13 14 

SNR (dB) 

Fig. 13. Simulation results for the concatenated system of Fig. |2]on the 
2D ISI channel with 2x2 averaging mask and AWGN, for the /3 = —1.5 
binary MRF of Fig. |5lb) with receiver parameter mismatch. 
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Fig. 14. Simulation results for the concatenated system of Fig. |2]on the Fig. 16. Simulation results for the concatenated system of Fig.|2|on the 2D 
2D ISI channel with 2x2 averaging mask and AWGN, for the /3 = —3.0 ISI channel with 2 X 2 averaging mask and AWGN, on the natural binary 



binary MRF of Fig. [Sjc) with receiver parameter mismatch. 



image "chair" of Fig. 1151 for various values of MRF parameter /3. 




(a) (b) 
Fig. 15. Two 64 X 64 natural binary images: (a) chair, and (b) man. 




SNR, the concatenated detector achieves SNR savings of 
between 1 and 2 dB compared to the ISI-only detector, 
for a wide choice of (3 values at the receiver, thereby 
demonstrating that a simple first-order MRF model is very 
useful in reducing 2D ISI in natural binary images. 

IV. Conclusion 

This paper has demonstrated that, if the input image to 
a 2D ISI channel has 2D correlation that can be modeled 
by a MRF, then significant SNR savings over previously 
proposed 2D-ISI detectors can be realized by employing a 
concatenated iterative decoder consisting of SISO 2D-ISI and 
MRF detectors, and that the SNR savings increase with the 
degree of source-image correlation. The techniques described 
in this paper have potential application in future-generation 
optical recording systems, which will employ 2D read/write 
heads. In practice, many source images destined for storage 
on such media are correlated; for example, uncompressed 
natural images are usually highly correlated, and most prac- 
tical image-compression schemes leave residual correlation. 
This paper has also demonstrated that the proposed algorithm 
is quite robust to MRF parameter mismatch between the 
source image and the receiver, and that the simple first- 
order MRF is a very useful model for 2D-ISI reduction 
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Fig. 17. Simulation results for the concatenated system of Fig.|2|on the 2D 
ISI channel with 2 X 2 a veraging mask and AWGN, on the natural binary 
image "man" of Fig.[l5l for various values of MRF parameter (3. 

in natural binary images. The basic ideas presented in this 
paper should extend to more realistic image models and more 
practical scenarios. Algorithms that learn an appropriately 
accurate MRF model from the source image would allow 
practical implementation of joint 2D-ISI and MRF estimators 
in optical storage systems; such algorithms are currently 
under investigation by the authors. 
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